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ON THE VALUE OF OPTIMAL STOPPING GAMES 

By Erik Ekstrom and Stephane Villeneuve 1 

University of Manchester and University of Toulouse 

We show, under weaker assumptions than in the previous litera- 
ture, that a perpetual optimal stopping game always has a value. We 
also show that there exists an optimal stopping time for the seller, 
but not necessarily for the buyer. Moreover, conditions are provided 
under which the existence of an optimal stopping time for the buyer 
is guaranteed. The results are illustrated explicitly in two examples. 

1. Introduction. In this paper we study a perpetual optimal stopping 
game between two players, the "buyer" and the "seller." Both players choose 
a stopping time each, say r and 7, and at the time r A 7 := min{r, 7}, the 
seller pays the amount 

(1-1) ri(T)l {T < 7} +Y 2 (7)l {r>7} 

to the buyer. Here Y\ and Y 2 are two stochastic processes satisfying < 
Y± (t) < Y 2 (i) for all t almost surely. Clearly, the seller wants to minimize the 
amount in (1.1) and the buyer wants to maximize this amount. 

We consider discounted optimal stopping games defined in terms of two 
continuous contract functions g\ and g 2 satisfying < g\ < g 2 and a one- 
dimensional diffusion process X(t). More precisely, given a constant dis- 
counting rate j3 > 0, let 

Y 1 (t) = e- l3t g 1 (X(t)) 

and 

Y 2 (t)=e-^g 2 (X(t)). 

Define the mapping R x from the set of pairs (r, 7) of stopping times to the 
set [0, 00] by 

(1.2) R x (r, 7 ) :=E x e-^(g 1 (X(T))l {T ^ } +g 2 (X( 1 ))l {T>l} ). 
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Thus, R x (t, 7) is the expected discounted pay-off when the players use the 
stopping times r and 7 as stopping strategies. Here the index x indicates that 
the diffusion X is started at x at time 0. In (1.2), and in similar situations 
below, we use the convention that 

f(X(a))=0 on {a = 00}, 

where / is a function and a is a random time. Next define the lower value 
V_ and the upper value V as 

V(x) :=supinf Rx{r,i) 

T 7 

and 

V(x) := inf sup (r, 7) , 

7 r 

respectively, where the supremums and the infimums are taken over random 
times r and 7 that are stopping times. It is clear that 

gi{x)<V(x)<V(x)<g 2 (x) 

(the first and the last inequality follow from choosing r = or 7 = in the 
definitions of V_ and V, resp.). If, in addition, the inequality 

V(x) > V(x) 

holds, that is, if V_{x) = V(x), then the stochastic game is said to have a 
value. In such cases, we denote the common value V_(x) = V(x) by V(x). If 
there exist two stopping times r' and 7' such that 

(1.3) Rx(t,J) < M-r'n') < Rx{r',l) 

for all stopping times r and 7, then the pair (t',7 7 ) is referred to as a saddle 
point for the stochastic game. It is clear that if there exists a saddle point 
for the stochastic game, then the game also has a value. 

It is well known (compare [2, 3, 10, 11, 13] and [15]) that under the 
integrability condition 

(1.4) E x ( sup e- l3t g 2 (X(t))) < 00 

\0<t<oo / 

and the condition 

hm e-P t g 2 (X(t))=0, 

t— >oo 

the stochastic game has a value V. Moreover, the two stopping times 

(1.5) r*:=m£{t:V(X(t)) = 9l (X(t))} 
and 

(1.6) j*:=M{t:V(X(t))=g 2 (X(t))} 
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together form a saddle point for the game. Below we prove the existence 
of a value under no integrability conditions at all. To do this, we use the 
connection between excessive functions and concave functions; compare [6] 
and [7]. More specifically, using concave functions, we produce a candidate 
V* for the value function, and then we prove that V_ > V* > V. Thus, there 
exists a value of the game, and this value is given by the candidate function 
V*. One should note that we prove the existence of a value for perpetual op- 
timal stopping games, that is, when there is no upper bound on the stopping 
times r and 7. It remains an open question if all optimal stopping games 
with a finite time horizon have values. 

One easily finds examples of stochastic differential games where the pair 
(t*,7*) of stopping times defined by (1.5) and (1.6) is not a saddle point; 
compare, for instance, the examples in Section 5.1. We prove below, however, 
that 7* is always optimal for the seller. More precisely, we deal with the 
following concepts closely related to the notion of a saddle point: a stopping 
time t' is optimal for the buyer if 

R x {r'n)>V{x) 

for all stopping times 7, and a stopping time 7' is optimal for the seller if 

R x {r,i)<V{x) 

for all stopping times r. Note that 

t' is optimal for the buyer and 7' is optimal for the seller 

( T ')7') is a saddle point. 

Also note that if r' is optimal for the buyer, then 

V(x) <infi4(T',7)< V(x) <V(x), 
7 

so the game has a value V{x) which is given by 

V{x)=miR x { T \ 1 ). 

7 

Similarly, if 7' is optimal for the seller, then the existence of a value V(x) 
follows, and 

V(x) = sup R x (r, 7')- 

T 

The outline of the paper is as follows. In Section 2 we specify the as- 
sumptions on the diffusion X and we show that a stochastic game with 
an infinite time horizon always has a value. This is done without the in- 
tegrability condition (1.4); compare Theorem 2.5. We also show that 7* is 
an optimal stopping time for the seller. The method used in the proof of 
Theorem 2.5 also gives a characterization of the value function in terms of 
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concave functions. As a straightforward consequence of this characterization, 
the smooth-fit principle is deduced in Section 3. In Section 4 we provide ad- 
ditional conditions under which r* is optimal for the buyer, that is, (r*,7*) 
is a saddle point. Finally, in Section 5 we explicitly determine the value of 
two different game options, both of which may be regarded game versions of 
the American call option. In these examples, the integrability condition (1.4) 
is not fulfilled, so they are not covered by the theory in previous literature. 

2. The value of a stochastic differential game. Let X be a stochastic 
process with dynamics 

(2.1) dX{t) = fJ,(X(t)) dt + a{X{t)) dW(t), 

where [i and a are given functions and W is a standard Brownian motion. 
We assume that the two end-points of the state space of X are and co, 
and we assume for simplicity that both these end-points are natural. We also 
assume that the functions /u(-) and cr(-) are continuous and that cr(x) > for 
all x € (0, oo). It follows that the equation (2.1) has a (weak) solution which 
is unique in the sense of probability law; see Chapter 5.5 in [12]. Moreover, X 
is a regular diffusion, that is, for all x,y G (0, oo), we have that y is reached 
in finite time with a positive probability if the diffusion is started from x. 
The second-order ordinary differential equation 

a 2 (x) 

(2.2) Cu{x) := — - — u xx + n(x)u x - /3u = 

has two linearly independent solutions tp, <p : (0, oo) — > K which are uniquely 
determined (up to multiplication with positive constants) by requiring one of 
them to be positive and strictly increasing and the other one to be positive 
and strictly decreasing; compare [5]. We let ip be the increasing solution 
and (p the decreasing solution. Since and oo are assumed to be natural 
boundaries of X, we have tp(0+) = = 99(00). We also let F : (0, 00) — > (0, 00) 
be the strictly increasing positive function defined by 

F(x) = ^ 

Recall that a function u : (0, 00) — ► M is said to be F-concave in an interval 
J C (0,oo) if 

/ \ , n F(r) -F(x) , ,F(x)-F(l) 

for all l,x,r G J with I < x <r. Equivalently, the function u{F~ l {-)) is con- 
cave. F-convexity of a function is defined similarly. 

Below we use the following two theorems relating concave and convex 
functions to the value functions of optimal stopping problems. The first one 
is Proposition 4.2 in [6]. The proof of the second one follows along the lines 
of the proofs of Propositions 3.2 and 4.2 in [6] and is therefore omitted. 
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Theorem 2.1. Let l,r be such that < I < r < oo, let g: [l,r] — > [0,oo) 
be measurable and bounded, and let 

U{x) := sup E x e-^g(X(r)), 

T<n, r 

where 

n , r :=M{t:X(t)t(l,r)}. 
Then U is the smallest majorant of g such that U/ip is F -concave on [l,r]. 

Theorem 2.2. Let l,r be such that < I < r < oo, let g : [l,r] — > [0, oo) 
be measurable and bounded, and let 

U(x) := inf E x e~^g(X( 7 )), 

7<7;,r 

where 

%r :=inf{t:X(t)t(l,r)}. 
Then U is the largest minorant of g such that U/ip is F -convex on [l,r]. 

Remark. Note that it is important in Theorem 2.2 that the stopping 
times 7 are to be chosen among stopping times not exceeding the first exit 
time 7; >r of X(t) from the interval (l,r). If, for example, the choice 7 = 00 
would be included, then U would be identically 0. 

Below we find our candidate value function V* in the set 

F = {/ : (0, 00) —s- [0, 00) : / is continuous, g\ < f < 52, 

f/ip is .F-concave in every interval in which / < 52}- 

Note that F is nonempty since 52 £ F. We work below with the functions 
Hi : (0, 00) — ► [0, 00), i = 1,2, defined by 

and the set 

H = {h: (0, 00) — > [0, 00) : h is continuous, Hi <h< H2, 

h is concave in every interval in which h < H2}. 

Note that the functions in F are precisely the functions <p ■ (h o F) for some 
function /i£H. 
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Lemma 2.3. Let {/i n }^ =1 be a sequence of functions in H. Then the 
function h defined by 

h(y) :=Mhn(y) 

is an element o/H. 

Proof. First we claim that the minimum of two functions in H is again 
in H. To see this, assume that hi,h,2 £i and let h := h\ A /i2- Clearly, /i is 
continuous and satisfies H\<h< H2. Let y € (0,co) satisfy h(y) < H2(y). 
Consider the two separate cases h\(y) 7^ h2(y) and h\(y) = /i2(y) < H(y)- In 
the first case, there exists an open interval containing y such that h = h\ or 
h = /12 in this interval and, thus, h is concave in this interval. For the second 
case, there exists an open interval containing y such that both h\ and /12 
are concave. Since the minimum of two concave functions is concave, h is 
also concave in this interval. It follows that h is concave in every interval in 
which h < H2, which shows that h € H. 

Thus, we may, without loss of generality, assume that /i n +i < h n for all 
n. Let h(y) := inf n h n (y) and define 

U:={y:h(y)<H2{y)}. 

Note that h, being the infimum of continuous functions, is upper semi- 
continuous, so U is open. Choose two points l,r EU with I < r and [I, r] C U. 
The interval [l,r] is compact, and it is covered by the increasing family 
{U n }^=i of open sets 

U n :={y:h n (y)<H2(y)}. 

Hence, there exists an integer N such that [Z,r] C U n for all n> N. For such 
n, h n is concave on [l,r], and therefore, also h is concave on this interval. 
Consequently, h is concave on each interval contained in U, and thus also 
continuous at all points in U. 

To show that h £ H, it remains to check that h is continuous also at all 
boundary points of U. Let I EU\U, where U is the closure of U in (0, 00), 
and let {l^'kLi be a sequence of points in U converging to I from the right 
(left-continuity is dealt with similarly). Because h is upper semi-continuous, 
it is enough to prove that h{l) < 

Assume first that (1,1 + Eq) C U for some £0 > 0. We assume, to reach a 
contradiction, that there exists e > such that h(l) — e > h(l+). Then there 
exists 5 > such that the straight line L connecting the points (I, h(l) — e) 
and (l + S,h(l + S)) satisfies h(y) < L(y) < #2(2/) for y G (1,1 + 5). Now, choose 
a y € (1,1 + 5). Then there exists an n such that h n (y) < L(y). For this n, 
h n (l) < L(l) since h n is concave and h n (l + 5) > L(l + 5). Consequently, 
h(l) < h n (l) < L(7) = h(l) — e, which is the required contradiction. 
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On the other hand, if there does not exist an eo > such that h < H 2 in 
(1,1 + eo), then the previous case can be applied to deduce right-continuity 
of h at /. Indeed, for e > 0, choose 5 > such that 

\H 2 (y)-H 2 (l)\<e for y£ [1,1 + 5}. 

Without loss of generality, we may assume that H 2 = h at 1 + 5 (since points 
with H2 = h exist arbitrarily close to I). Now, for a point Ik G (1,1 + 5), there 
exists a maximal (possibly empty) surrounding interval in which h < H 2 . 
We know from above that h is concave in the closure of this interval, and 
thus, h > H 2 (l) — £ in the interval. In particular, h(lk) > H 2 (l) — e. Since we 
also have h(lk) < H 2 (lk) < H 2 (l) +e, and since e is arbitrary, it follows that 
h(lk) — > H 2 (l) = h(l) as k — > 00. Hence, /i is continuous at i, and thus, we 
have shown that h G H. □ 



Lemma 2.4. There exists a smallest element V* € F. Moreover, the 
function V* /<p is F -convex in every interval in which V* > g\. 

Proof. Since the functions in F are precisely the functions tp(x)h(F(x)) 
for some function it suffices to show that there exists a smallest 

element in H and that this smallest element is convex in every interval of 
strict majorization of H\. In order to do this, define 

Being the infimum of continuous functions, W is itself upper semi-continuous. 
Let {y/olfc^i be a dense sequence of points in (0,co), and for each k, let 

be a sequence of functions in H such that inf n h^d/k) = W(yk)- Next, define 
the function W* by 

W*(y)=mfmfh k n (y). 

k n 

According to Lemma 2.3, W* € H. Moreover, the nonnegative function W* — 
W is lower semi-continuous and vanishes on a dense subset of (0, 00). It 
follows that W = W* , so W G H, which finishes the first part of the proof. 

To show the convexity on each interval in which W > H±, let / be such 
an interval and fix y' G /. By continuity of Hi, H 2 and W , we can find 5 > 
so that 



M W(y) > supFi(y), 
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where I s := [y' — 5, y' + 5] . Now assume, to reach a contradiction, that there 
exist points yx, y2 G I s with y\ <y' < y2 and 

(2.4) W(y') > W{ yi )^^- + W(y 2 )^^- =: L{y>). 

2/2 - 2/1 2/2 - 2/1 

Since is continuous, W{y) > L(y) for y in an open set containing y' . Let 
us introduce 

y'l = sup{y G [yi, y'] , W{y) = L{y)} 

and 

y 2 = M{ye[y',y 2 ],W(y)=L(y)}. 
It is now straightforward to check that the function 

h(ll \ — l L (y), if 2/ebi,y 2 ]> 

satisfies /i€H. However, /i < W in y € (2/1,2/2) contradicts the minimality of 
W, and thus, (2.4) is not true. This means that W is convex at the point 
y' , so, by continuity, W is convex on I, which finishes the second part of the 
proof. □ 

Theorem 2.5. For any starting point x > 0, the perpetual optimal stop- 
ping game has a value V(x) :=V_{x) = V(x). Moreover, V = V* , where V* 
is the function appearing in Lemma 2A, and the stopping time 

1 *:=M{t:V(X(t))=g 2 (X(t))} 

is an optimal stopping time for the seller. 

Proof. Let V* be the function in Lemma 2.4, and choose x G (0,oo). 
To prove the existence of a value, we will show that 

(2.5) V(x) <V*{x) <V(x). 

To prove the first inequality, assume that the maximal interval containing x 
in which V* < g 2 is (I, r) for some points I < r [if V*{x) = g 2 (x), then the first 
inequality obviously holds since V < g 2 \. Assume also, for the moment, that 
< / and r < 00. It follows that V*(l) = g 2 (l) and V*(r) = g 2 {r). Inserting 
7 = 7/ jT . in the definition of V yields 

V(x) < supE x e-^ A ^( 5 i(X(r))l {r < 7ir} + g 2 (X ( %r ))l {r>ll r} ) 

(2.6) < sup ¥, x e-P T g*(X( T )) 

r <7i,r 

=: U*(x), 
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where the function g* is defined by 



K ' \92{x) 



if x € (l,r), 
if x € {I, r}. 



Note that V* majorizes g* and that V*/ip is F-concave on (l,r). Accord- 
ing to Theorem 2.1, U* is the smallest such function, so U*(x) < V r *(x). 
Consequently, 



Now, if we instead have = I and/or r = oo, then the above reasoning again 
applies if we plug in 7r . := inf{i :X(t) > r}, 7^ := inf{i : X(i) < 1} or 7 = 00 
in the definition of V and use Propositions 5.3 or 5.11 in [6] instead of 
Theorem 2.1. 

To show the second inequality in (2.5), we argue similarly. Choose an x 
and let (l,r) be a maximal interval containing x in which V* > g±. As above, 
let us first assume that 

(2.9) 0<l and r < 00. 

Inserting r = Ti >r in the definition of V_ gives 



Thus, since V*/ip is F-convex in (l,r) (see Lemma 2.4), it follows from 
Theorem 2.2 that V_{x) > V*(x). Thus, we have shown the second inequality 
in (2.5) under the assumption (2.9). 

Now, if (2.9) is not the case, then the second inequality in (2.5) requires 
some slightly more involved analysis. For example, assume that 

(2.10) 0<l and r = 00. 

To prove V_(x) > V*(x), in this case we do not plug in 77 := inf{t : X(t) < 1} in 
the definition of V_, but we rather use the stopping times t^n = inf{t : X(t) ^ 
(I, N)} for different N > / (compare the remark following the current proof). 
Thus, for any N >x, choosing r = r^jy m the definition of V_ gives 



(2.8) 



V(x)<V*{x). 





(2.11) V{x)>\ntR x {T l , Nll )= inf E x e-^g*(X( 7 )) =: Viv(x) 
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From Theorem 2.2, it follows that V/v is majorized by <?*, that Vjsr/ip is F- 
convex on [Z,iV], and that Vjv is the largest function with these properties. 
It is clear from (2.8) and (2.11) that 

supV N {x)<V(x)<V*{x). 

N>x 

We show below that we in fact have 

(2.12) supV N (x)=V*(x). 

N>x 

Note that (2.12) implies that 

V(x)=V*(x) 

and therefore also the existence of a value. To prove (2.12), we will work in 
the coordinates y defined by y = F(x). 

Let Hi, i = l,2, be defined by H { = & o F~ l . Then 

W N , := — o F" 1 ,N']^^L 

is the largest convex function majorized by the function 

H 2 (y), ]£ye(l',N'), 



(2.13) H(y) := { 



H^y), iiye{l',N'}, 



where I' := F(l) and N' := F(N). Let W := ^—oF" 1 (thus, W is the function 
defined in the proof of Lemma 2.4). The conditions < I and r = oo translate 
to I' > 0, W(l') = Hi(l') and W(y) > H^y) for all y > I'. Next, for y > I', 
define 

W(y) := sup W N >{y). 

N'>y 

We need to show that W >W. To do this, note that since W > H\ in the 
interval [l',oo), we know from Lemma 2.4 that W is convex in this interval. 
Choose yo> I', let 

fc . = Hm W(y + s)-W(y ) 



e\0 e 

be the right derivative of W at yo, and let L(y) = k(y — yo) + W(yo) be the 
steepest tangential of W at yo- Note that L(y) < W(y) < H^iy)- Now we 
consider two cases. 

First, assuming the existence of a point N' > yo such that L(N') = Hi(N'), 
the function 



%) 



(W(y), ifye[l',y ], 
\L(y), if ye[y ,N'], 
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is convex and dominated by H2 in (/', N') and by H\ at the points I' and N' . 
Therefore, h < W^i by Theorem 2.2, so 



Second, assume that there is no point N' > y$ such that L(N') = H\(N'). 
Note that the function 



is an element of the set EL Since W is the smallest function in this set, it 
follows that we must have W(y) = L{y) for all y > yo- Moreover, for each 
e > 0, there exists a point of intersection (to the right of yo) between the 
line L 6 (y) := (k — e)(y — yo) + W(yo) and Hi (otherwise a function in H can 
be constructed which is strictly smaller than W in some interval). Now, let 
z < W(yo), and consider the straight lines through (yo,z) that are below 
W in the interval [l',yo\- Let k' be the slope of the largest such straight 
line (i.e., k! is the smallest possible slope), denote this line by V , and let 
y' € [I', Ho) be the largest value for which W = L' . Since W is convex in 
[l',oo), we have that k' < k, and thus, the straight line through (yo,W(yo)) 
with slope k' and the function H\ have a point (N' , H\(N')) of intersection 
for some N' > yo- Let L" be the straight line between the points (yo,z) and 
(N' , Hi(N')). Then the function which equals W in [l',y'], L' in [y',yo] and 
L" in [yo, N'] is convex and smaller than the function H defined as in (2.13). 
Consequently, the corresponding function Ww satisfies Wjv'G/o) > z. Since 
z < W(yo) is arbitrary, it follows that W(yo) > W(yo). 

Thus, we have shown under the assumption (2.10) that (2.12) holds, im- 
plying the second inequality in (2.5). By symmetry, the above argument also 
applies in the case when I = and r < 00. The remaining case, that is, when 
/ = and r = 00, can be handled with similar methods (we omit the details). 

Finally, since we have shown that the first inequality in (2.6) actually is 
an equality, it follows that 7* is optimal for the seller. □ 

Remark. Note that the function W in the proof of Lemma 2.4 is the 
smallest function in the set 

H = {h : (0, 00) — > [0, 00) : h is continuous, Hi <h< H2, 

h is concave in every interval in which h < H2}, 

whereas, in general, it is not the largest function in the set 



W(y ) > W(y ). 




if y € (0,2/oL 
if y 6 [?/o,oo) 



{h : (0, 00) — > [0, 00) : h is continuous, Hi <h< H2, 

h is convex in every interval in which h > Hi} 
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(although W is a member also of this set). This asymmetry of the function 
W (and the corresponding one for the function V*) may be regarded as the 
underlying reason for the asymmetry in the proof of the first and the second 
inequality in (2.5). 

Remark. Let us introduce the perpetual American option value V^o 
associated with the payoff g\, that is, 

(2.14) V^x) := su P E xe - /3r 5l (X(T)). 

r 

Obviously, V < Voq. An immediate consequence of Theorem 2.5 is that the 
implication 

Voo(xo) > g 2 (x ) for some x € (0, oo) => {x :V(x) = g 2 (x)} ^ 

holds. Indeed, assume that V^o(xo) > #2(^0) for some xq and that V{x) < 
g 2 (x) for all x € (0, 00). Then 7* = 00, so V = by Theorem 2.5. It follows 
that V(xq) > g 2 (xo), which is a contradiction. 

3. The smooth-fit principle. In the following proposition, let H\ and H 2 
be the functions defined in (2.3) and let W be the smallest element in the 
set H. Moreover, let ^ and ^ denote the left and the right differential 
operators, respectively, that is, 

d~ s v h(y ) - h(y - e) 

— h{y ) := hm 

ay e\o — e 



and 



d + , h(y + e) - h(y ) 

-h(y Q ) := hm 



dy e\o e 

PROPOSITION 3.1. Assume that y± G (0, 00) is such that Hi(yi) = W (yi) < 
H 2 (yi). Also assume that the left and right derivatives and ^jH\ exist 

at yi . Then 

(3-1) ^#i(yi) > ^-^(yi) > ^W(yi) > ^Fi(yi). 

"2/ dy dy dy 

Similarly, if y 2 £ (0, 00) is such that H 2 (y 2 ) = W{y 2 ) and ^H 2 and ^jH 2 
exist at y 2 , then 

(3.2) ^-^1(2/2) < ^-W(y 2 ) < ^-W{y 2 ) < ^Fi(y 2 ). 

dy dy dy dy 

Proof. Since W(y\) = Hi(yi), the first and the third inequality in (3.1) 
follow from V > H\. Since W(yi) < H 2 (yi), we know that W is concave in 
a neighborhood of y\. From this, the second inequality follows. 

The inequalities in (3.2) follow similarly. □ 
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Remark. Note that for the middle inequalities in (3.1) and (3.2) to 
hold, it is essential that W(yi) < #2(2/1) and -Hi (7/2) < W(y 2 ), respectively. 
Indeed, (3.1) is, for example, not true at the point y\ = K\ if 

H x (y) = (y A K 3 - K 2 )+ 

and 

H 2 (y) = (y-K 1 )+ 
for some constants K% > K 2 > K\ > 0. 

After a change of coordinates, Proposition 3.1 translates to the following 
smooth-fit principle. Note that, in line with the above results, no integrabil- 
ity conditions are assumed. 

Corollary 3.2 (Smooth-fit principle). Let xq £ (0, 00) and assume that 
V(xq) = gi(xo), where either i = l or i = 2. Assume also that gi(xo) < 32(^0) 
and that gi is differentiate at x$. Then also V is differentiable at xq and 

^^o) = ^(xo). 

4. Existence of a saddle point. According to Theorem 2.5, 7* is an op- 
timal stopping time for the seller. It turns out, however, that 

r* :=mf{t:V(X(t))= gi (X(t))} 

in general need not be optimal for the buyer; compare the examples in 
Section 5. A necessary condition for (r*,7*) to be a saddle point is that 

F(t* < 00) > 0, 

or, equivalently, that the set 

E 1 :={xe{0,oo):V(x)=g 1 (x)} 

is nonempty. Indeed, R x (oo,oo) = 0, and thus, r* = 00 cannot be optimal 
for the buyer (at least not if g\ ^0). Below we give an analytical criterion 
in terms of the differential operator 

2 dx 2 dx 

ensuring that the set E\ is empty. To this end, we restrict the class of payoff 
functions by requiring some additional regularity conditions. 
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Hypothesis 4.1. Let D = {ai, . . . , a n }, where n G N and a; are positive 
real numbers with a\ < 0,2 < - ■ ■ < a n . Suppose that g\ is a continuous func- 
tion on (0, 00) such that g[ and g'{ exist and are continuous on (0, 00) \ D 
and that the limits 

g' 1 (a i ±) := lim q[{x), g'{(fli±) := lim a'({x) 

x—><n± x—tai± 

exist and are finite. 

Proposition 4.2. Assume that the function g\ satisfies Hypothesis 4.1 
and that gi > g\ on some open interval X C (0, 00). If Cg\ is a nonzero 
nonnegative measure on X, then V(x) > gi(x) for every x €X. Thus, ifX = 
(0,oo) ; then the set E\ is empty, and consequently, r* is not optimal for the 
buyer (provided gi^=0). 

Similarly, if Cg2 is a nonzero nonpositive measure on X, then V(x) < 
92{x) for all x £ X. 

Remark. That Cg\ is a nonnegative measure on X means that Lg\ (x) > 
for all x G X \ D and g[(a—) < g[(a+) for all a£lnD. That Cg\ is a 
nonzero nonnegative measure on X means that at least one of these inequal- 
ities is strict. 

Proof of Proposition 4.2. Fix x el and choose l,r eX with I < x < 
r so that Cg\ is a nonzero nonnegative measure on (l,r) CX. According to 
Theorem 2.5, V(x) = sup r R x (r, 7* ) and thus 

(4.1) V(x)>R x (r l , r , 1 n>Me-^ Tl - rAr) 9i(X(T^ r A^))). 

Note that if P x (7* < 7/ jr ) > 0, then the second inequality in (4.1) is strict. Be- 
cause gi satisfies Hypothesis 4.1, the Ito-Tanaka formula (see Theorem 3.7.1, 
page 218 in [12]) gives 

Exie^^'gill^Af))) 

/ pti r A7* 

= g 1 (x)+mJj o ' e- ps Cgi{X(s))ds 

+ E (9'M+)-g' l {a i -))KJJ e^ s dL\ S ) 

where L l is the local time of X at a^. Now, since Lg\ is nonnegative on (l,r), 
we find that 

E x (e-^ A ^ 9l (X(T ljr A^)))> gi (x). 

Moreover, if 7* > r^ r a.s., then this inequality is strict. Indeed, since Cg\ is 
a nonzero nonnegative measure on (l,r), we have that either Cg\{y) > for 
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some y € (I, r), where g\ is differentiable (implying that the middle term is 
strictly positive), or g' 1 (ai+) > g[(ai—) for some aj G (I, r) (implying that the 
last term is strictly positive). Thus, in view of (4.1), we have V(x) > gi(x), 
which finishes the proof of the first part of the proposition. 

As for the second claim, by Proposition 4.4 in [6] [note that it is also valid 
for contracts, functions of the type (2.7)], we may replace (4.1) with 

V(x) <supR x (r,-fi !r ) =Rx(r,% r ) 

T 

for some stopping time f. The proof now follows as above. □ 



Below we provide conditions under which r* is optimal for the buyer. Fol- 
lowing [1] and [6], the conditions are expressed in terms of the two quantities 

, v 9i(%) , , ,. 9i(x) 
<o:=hmsup — i— and too := lim sup . 

x ^0 tp[x) x^oo 1p{x) 

Proposition 4.3. Assume that both Iq and are finite. Also assume 
that the nonnegative local martingales e~ /3t ip(X(t)) and e^^ t tp(X(t)) satisfy 

(4.2) E x ( sup e~ p8 (p{X(8))) < oo and E x ( sup e- /3 >(X(s))) < oo 

\0<s<t ) \0<s<t J 

for all times t. Then the process e~@ tAT V(X(t At*)) is a sub-martingale. 



Proof. We know from Theorem 2.5 that V/(p is F-convex in all inter- 
vals where V > gi- Arguing as in the proof of Proposition 5.1 in [6], it can 
therefore be shown that Z(t) := e- ptAT *V(X(t A r*)) is a sub-martingale, 
provided 



E x sup Z(s) < oo 
\0<s<t / 

(this is needed for the use of Fatou's lemma). From the results in [6] (compare 
Propositions 5.4 and 5.12 of that paper) we know that 

r V ^ i a v V ^ i 
hm sup — —- = Iq and lim sup —i—r = too • 

x^O (f{x) x^oo 1p{X) 

Thus, there exist constants C and D with 

V{x) <C<p(x) + D^j(x) 

for all x £ (0, oo). From the assumption (4.2), it therefore follows that 
supci <s<t Z(s) is integrable, which completes the proof. □ 
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Remark. Without the assumption (4.2), Proposition 4.3 would not be 
true. Also note that to show that the process e~^ tA7 V(X(t A 7*)) is a 
super-martingale, neither the finiteness of Iq and nor the condition (4.2) 
is needed. 

The following two results may be viewed as the game versions of Propo- 
sition 5.13 and 5.14 in [6]. 

Theorem 4.4. Assume (A.2) and that 
(4.3) l = loo = 0. 

Then (r*,7*) is a saddle point. 

PROOF. From Proposition 4.3, it follows that 

V(x) < E x (e-^ tAr * A ^V(X(t At* A 7))) 

< E x ( e -^V(X(T*))l {r .< tA7} + e~^(X( 7 ))l {7<tAr * } ) 

+ E x (e- (3t V(X(t))l {t < T , Aj} ) 

for any stopping time 7. We first prove that the last term converges to zero 
when t tends to +00. To do this, recall that the assumption (4.3) implies 

, V(x) , V(x) 
lim — )-r = lim -f^ = 0. 

x^O ip(x) x^oo ip[x) 

Thus, given a constant 5 > 0, there exists a constant M such that V(x) < 
8ip(x)+5ip(x)+M for all x. Using the fact that e-^<p(X(t)) and e-^(X(t)) 
are nonnegative local martingales, and hence supermartingales, we find 

E x (e-^V(X(t))l {t < T * Al} ) < Me~ pt + 5E x e- 0t ip(X(t)) + SK x e~^{X{t)) 

<Me~ pt + 8ip{x)+8^(x). 

Since 5 can be chosen arbitrarily, we conclude the first step. Next, the mono- 
tone convergence theorem yields 

V(x) < lim E*(e-^V(X(T*))l {r *< tA7} + e -^F(X( 7 ))l {7<tAr . } ) 

<^E a (e-^^(X(r*))i {T .< tA7} + e -^(X( 7 ))i {7<tAT , } ) 

= E x .(e-^* ffl (X(r*))l {T ,< 7} + e-% 2 (X( 7 ))l {7<r , } ) 
= ^(r*, 7 ), 

that is, r* is optimal for the buyer. This completes the proof. □ 
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Theorem 4.5. Assume (4.2) and that lo and are both finite. Then, 
the pair (t*,7*) is a saddle point for arbitrary starting point if and only if 

there is no I > such that "] ( there is no r > such that ' 

g±(x) < V{x) for all x <l > and < g\(x) < V(x) for all x>r 
ifk>0 J 1 i//oo>0 

Proof. If Iq = l^ = 0, then the result follows from Theorem 4.4. There- 
fore, we assume that l^ > (the case Iq > can be treated similarly). 

To prove the sufficiency of the condition, fix a starting point x € (0, oo). 
If V{x) = gi(x), then r* = is clearly optimal for the buyer, and thus, we 
are finished. If V(x) > gi(x), let / := (a, b) C (0, oo) be a maximal interval 
containing x such that V > g\ in /. Note that 

t* = inf {t:X{t) <£I}, 

and that b < oo by assumption. Moreover, given 5 > 0, there exists a constant 
M such that V < M + 5<p in I. Indeed, if a > 0, then V is bounded in /, and 
if a = 0, then Iq = by assumption. Thus, proceeding analogously as in the 
proof of Theorem 4.4, we obtain 

V(x) < lim E x (e- /3 (' AT * A7 V(X(t At* A 7))) 

t— »oo 

< Urn E*( e -^V(X(T*))l {T *< tA7} + e-^y(X( 7 ))l {7 <MT*}) 

+ <fy>(x) + lim Me _/3t 

<i? x (r*,7) + (5^(x) 

for a stopping time 7. Since <5 is arbitrary, this shows that r* is optimal for 
the buyer. 

Conversely, assume that (r*,7*) is a saddle point for each starting point x 
and that V{x) > gi{x) for x>r. Then, for x >r, the stopping time r* > r r 
a.s. The definition of a saddle point and the optional sampling theorem 
applied to the nonnegative supermartingale e _ ^*V r 00 (Xt), where Voc is the 
perpetual American option value as defined in (2.14), give 

V(x) = R x (t*,Y) 

< R x (r*, 00) =M x (e~^* 9l (X(T*))) 

<E x (e-^> 00 (X(r*))) 

<E x ( e - /3r ^ 00 (X(r r ))) 

<P\r) 



18 E. EKSTROM AND S. VILLENEUVE 

where we in the last equation used (2.6) in [6]. Proposition 5.4 in [6] then 
implies that 

loo = hmsup — - < — — — hm — — = 0, 

a;->oo 1p{X) <p{r) ^°oyj(x) 

which contradicts l^ > 0. □ 

5. Two examples of game options. In this section we study two exam- 
ples motivated by applications in finance. In both examples we assume that 
n(x) = fix, where (5 is the discounting rate. Thus, the diffusion X solves 

dX(t) = /3X(t) dt + a(X(t)) dW(t), 

and V may be interpreted as the arbitrage free price of a game option written 
on a nondividend paying stock; compare [14]. Note that the functions ip and 
(p are given (up to multiplication with a positive constant) by 

tp(x) = x 

and 

(5.1) ip(x)=x[ -4rexp(- / dzXdu. 

Jx u L J i o- z (z) J 

5.1. The game version of a call option. In this subsection we study the 
game version of a call option, that is, 

g\{x) = (x — K) + and g2{x) = (x — K) + + e 

for some positive constants K and e. If s > K, then one can show that 
the game option reduces to an ordinary perpetual American call option. 
Therefore, we consider the case with e < K. 

The functions Hi := o F , i = 1, 2, are given by 

Hi(y) = (y 



and 



H 2 (V)=[V- » ) + 



First we claim that the function 

1 



w(y) :-- 



<p{F- x {y)) 

is concave. To see this, note that by letting y = F(x), we find that 

1 1 F(x) y 



w(y) 



<p{F-\y)) tp{x)~ x F~\ y y 
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where we have used F{x) = x/<p(x). Straightforward calculations yield that 

w "(y) & 

Using (5.1), one can check that <p"(x) > 0, so it follows that w is concave. 
Since w is concave, H\ is on (0,F(K)) and convex in [F{K), oo), and H2 
is concave in (0,F(K)) and convex in (F(K) , 00) . This, together with the 
easily checked facts 

Hm^M = l, fl< 2 (y)<l 

y^oo y 



and 



K K 2 F'(K) K F(K) ' 
implies that the smallest function W in EI is given by 

{H 2 (y), if !/€(F(A'),oo). 

In the usual coordinates this means that the value V of the game version of 
a call option written on a no-dividend paying stock is 

ix — K + e, if xe(K, 00). 

According to Theorem 2.5, an optimal stopping time for the seller is given 
by 

7* :=mf{t:X(t) >K}. 

Also note that the corresponding stopping time r* = 00 is not optimal for 
the buyer. 

5.2. An example in which convexity is lost. In this subsection we consider 
another possible generalization of the American call option. More precisely, 
let 

g 1 (x) = (x-K) + and g 2 (x) = C(x - K) + 

for some constant C > 1. Moreover, assume for simplicity that the diffusion 
X is a geometric Brownian motion, that is, that 

dX(t) = (3X(t) dt + aX(t) dW(t) 

for some constant a > 0. Then the functions ip and ip are given by 

ip(x) = x and tp(x) = x~ 2 ^^ 2 , 
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and the functions Hi, % = 1, 2, are given by 

HM = {y-KyWW + ^) + and H 2 (y) = C(y - K y^ + ^) + . 
We need to consider two different cases. 

5.2.1. Case 1. First assume that C > 1 + 2f3/a 2 . Then it is straightfor- 
ward to check that W(y) = (y - K^ +a ^' /fT ' '')+ , that is, the value V of the 
option is given by 

V(x) = <p(x)W(F(x)) = (x- K W+« 2 )/° 2 x -W/° 2 )+. 

Moreover, Theorem 2.5 tells us that 7* := inf{t:X(t) < K} is an optimal 
stopping time for the seller. 

5.2.2. Case 2. Now assume that 1 < C < 1 + 2/3 jo 1 . Then one can check 
that 



W(y) 
where y' is given by 



y' 



H 2 (y), ifye(0,y'), 
H 2 {y') + y-y', if ye[y', 00), 



2pCK \ W+° 2 )l° 



(20 + a*)(C-l) 



It follows that 



C(x-K)+, iixe(0,x'), 

V(x) = { CKa 2 (x'\^l^ c . , , 

, it x G [x , 00), 



where 



2(3 + a 2 \x 

2(5CK 

x - 



(2f3 + a 2 )(C-lY 

According to Theorem 2.5, 7* := inf{t : X(t) < x'} is optimal for the seller. 
As in the previous example, however, r* = inf{i :X(t) < K} is not optimal 
for the buyer. 

Remark. The above example shows, perhaps surprisingly, that game 
options are not convexity preserving. More precisely, although both con- 
tract functions g\ and g 2 are convex, the value of the game option need not 
necessarily be convex. This is in contrast to options of European and Amer- 
ican style, both of which are known to be convexity preserving; compare, for 
example, [4] or [9] and the references therein. 
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Remark. The method to determine the value of an optimal stopping 
game used in this section is also used in [8]. In that paper the construction of 
the value using concave functions is shown to be valid under the assumption 
of the existence of a value and a saddle point of the form (r*,7*). In the 
present paper we start with the construction of a natural candidate for the 
value function (without knowing a priori that such a value function exists), 
and then we show that this function indeed has to be the value of the game. 
This allows us to weaken the assumptions under which a game is known to 
have a value. Also note that the integrability condition (1.4) is satisfied in 
neither of the two examples provided in this section. 

Acknowledgment. The authors thank an anonymous referee for very 
helpful comments. 
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